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AN EXPLICIT FUNDAMENTAL DOMAIN FOR THE PICARD 
i/-^ ■ MODULAR GROUP IN TWO COMPLEX DIMENSIONS 

o ■ 
o 

(SI ■ GABOR FRANCSICS AND PETER D. LAX 

\ Abstract. Our main goal in this paper is to construct the first explicit fundamen- 

tal domain of the Picard modular group acting on the complex hyperbolic space 
0^ \ CH^. The complex hyperbolic space is a Hermitian symmetric space, its bounded 

' realization is the unit ball in equipped with the Bergman metric. The Picard 

modular group is a discontinuous holomorphic automorphism subgroup of SU{2, 1) 
' with Gaussian integer entries. This fundamental domain has finite volume, one 

, cusp, explicitly given boundary surfaces and an interesting symmetry. 

■B 

1. Introduction 

Our main goal in this paper is to construct the first exphcit fundamental domain 
i of the Picard modular group PU{2, 1; acting on the complex hyperbolic space 

^ I CH^. The complex hyperbolic space CH" is a rank one Hermitian symmetric space 

' of noncompact type. Its bounded realization is the complex unit ball of C" equipped 
with the Bergman metric. The Picard modular group PU{n, l]Z[i]) is a discontinuous 
holomorphic automorphism subgroup of CH" with Gaussian integer entries. It is the 
O I higher dimensional analogue of the modular group, PSL{2, Z), in C". 
^ ■ Fundamental domains for lattices in rank one symmetric spaces attracted much 

d . attention during the last three decades. Although remarkable progress has been 
^ I achieved, several important problems related to arithmeticity, existence of embedded 
eigenvalues in the continuous spectrum etc., are still open. The general structure of a 
fundamental domain for lattices is well known since the work of Garland- Raghunathan 
[GR], for example. However there are very few fundamental domains known com- 
! pletely explicitly. This is especially true for complex hyperbolic spaces. Constructing 
explicit fundamental domains in complex hyperbolic spaces is much more difficult 
than in real hyperbolic spaces. This phenomenon is well known since the work of 
Mostow [M]. Recently very strong progress has been made in constructing explicit 
fundamental domains for discrete subgroups of complex hyperbolic spaces; see for 
example, the work of Cohen [C], Holzapfel [HI], [H2], Goldman [G], Goldman-Parker 
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[GP], Falbel-Parker [FPl], [FP2], Schwartz [Sch], Francsics-Lax [FLl], [FL2]. How- 
ever, explicit fundamental domains do not seem to be known in the literature for the 
Picard modular groups, e.g., sec the comment in [FP2]. 

Our method builds on the construction of a semi-explicit fundamental domain by 
the authors [FLl], [FL2] for the Picard modular group PU{2, l;Z[i]). This method 
uses Siegel sets on the unbounded hyperquadric model of the complex hyperbolic 
space. The spectral analysis and the scattering theory of the corresponding automor- 
phic Laplace-Beltrami operator are developed in [FL3] . Some of the results discussed 
here were announced at the conference "Geometric Analysis of PDE and Several 
Complex Variables" in Serra Negra, Brazil, in 2003. After completing this paper the 
authors received the interesting preprint of Falbel-Parker [FP2]. In [FP2], a funda- 
mental domain is constructed for the Eisenstein-Picard modular group using very 
different methods. 

The main results of the paper are the following theorems: 

Theorem 1. A fundamental domain for the Picard modular group is 
T = e C^; < Uezi, < '^mz^, 3?e^i + "^mzi < 1, 
|5Rez2| < ^, Qi{z) = \z2f > 1, 

Q3+r{z) = |r + i - (1 + i)zi + 2;2p > 1, r = -1, 0, 1, 
Q5+i±l{z) = \r + i- 2izi + 2z2f > 2, r = -1, 1, 

Q7+i+l{z) = \r + i-2zi + 2z2\^ > 2, r = -1, 1 } 



Theorem 2 contains more precise description of the structure of the fundamental 
domain J^. 

Theorem 2. There are eight explicitly known holomorphic automorphims Gi — 
J,G2, ■ ■ ■ in the Picard modular group such that the set 

T = {zeC"^; < ^ezi, < Qmzi, ^ezi + Qmzi < 1, 

\^ez2\ < ^, \Z2\' > 1, 

|detG;.(z)p<l, j = 2,...,8} 

is a fundamental domain of the Picard modular group acting on the complex hyperbolic 
space CH^. All eight transformations are needed. The transformations Gi,...,Gs 
can be described as follows: 

There are four transformations with dilation parameter 1: 

Gi{Zi,Z2) = J{Zi,Z2) = { — ,- — ), (1) 
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Gr+3 = J O Pr+3 = J O N^i+i^r+i) ° M_i, r = -1, 0, 1. 

There are four transformations with dilation parameter -\/2; 
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(2) 



and 



-1,1, 



(3) 



V2 



-1,1. 



(4) 



The precise definition of the holomorphic automorphisms P, J, N, A, and M is 

described in Section 2. Wc mention that the functions Qj in Theorem 1 are the 
Jacobian determinant of the transformations Gj to some power, see also (8) and (9) 
for more details. 

Three important geometric properties of the fundamental domain T are stated in 
the following theorem. These properties play a crucial role in our approach to the 
Laplace-Beltrami operator associated to the Picard modular group. The spectral and 
scattering analysis of the corresponding automorphic Laplace-Beltrami operator is 
developed in [FL3]. 

Theorem 3. (i) The fundamental domain T is invariant under the involutive trans- 
formation S{zi, Z2) = {izi, —Z2). 

(a) The two dimensional edge of the fundamental domain at Zi — is identical 
to the standard fundamental domain for the modular group. More precisely, 

jr n = 0} = {(0, Z2) e \^ez2\ < ^, ^mz2 > 0, \z2\ > 1}. 

(Hi) The fundamental domain T has a product structure near infinity, that is, for 
large enough a > 

Tr\{z^ C^; ^mz2 > a} = {-z e C^; < 3?e^i, < $>mzi, 

JRe^i + '^mzx < 1, |3?e2;2| < -, ^mz2 > a}. (5) 

RemEirk 1. The existence of a symmetry like S in Theorem 3 for a general discrete 
automorphism group has important consequences for the spectrum of the automor- 
phic Laplace-Beltrami operator. In particular, it implies the existence of infinitely 
many embedded eigenvalues in the continuous spectrum. These results will appear 
elsewhere. 
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Remctrk 2. We mention that the following identities hold for the transformations 
Gj,j^l,...,8: 

SGiS — Gil 

SGr+sS — G-r+3, r =—1,0,1, 

SG^^r^S = G,^^, r = -l,l. (6) 



2. Preliminaries 

In this section we review the necessary background material on complex hyperbolic 
space and Picard modular group. A more extensive treatment of these topics may be 
found in [E], [G], [C] and [T]. 

The Hermitian symmetric space SU(n, 1)/S(U(1) x U(n)) is called as the com- 
plex hyperbohc space, CH". A standard model of the complex hyperbohc space 
is the complex unit ball — {z & C"; \z\ < 1} with the Bergman metric g — 
Yl],k=i9j,k{z)d-Zj ® dzk, where gj^k = const ■ (9j(9fclog(l — We will use also the 

unbounded hyperquadric model of the complex hyperbolic space, that is = {z & 
C"; Qmzn > lJ2jZi The biholomorphic function 



maps the hyperquadric onto the unit ball 5". 

The holomorphic automorphism group of CH", Aut(CH"), consists of rational 
functions g ^ {gi, . . . , g^) : D"" t-^ D"", 

+ J2k=2 (^l,kZk-l 



9A^) = — , v^n+i„ ^ ' j = l,...,n. 



The automorphisms act linearly in homogeneous coordinates (Co,---,Cn), 2; — - 



j — 1, . . . ,n. The corresponding matrix A — [ajk]l^k=i satisfies the condition 



J ~ Co' 

A*GA = C, (7) 

where 

/ i\ 
C= 7„_i 
\-i / 

and In~i is the (n — 1) x (n — 1) identity matrix. The determinant of the matrix A 
is normalized to be equal to 1. The matrix C is the matrix of the quadratic form of 
the defining function of written in homogeneous coordinates. 

We now describe three important classes of holomorphic automorphisms stabilizing 
00. 
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Example 1. Heisenberg translations. Let a G dD^. Then the Heisenberg translation 
Na e Aut(CH^) is defined as Na{z-i,Z2) — {zi + ai,Z2 + 02 + iziCii). If we write 

with 7 e C, r G R then the Heisenberg translation is 



(7,r + t 

|2(^l) 

representation is 



71 



given by A^^_^+. |^|2(^i, ^2) 



(-^1 + 7, -^2 + + I ItI^ + izi^) . The corresponding matrix 





/ 1 









1 


1 








TV = 


ai 


1 





- 




7 


1 







\ 02 


iai 






\ 


r + 1 7p 


27 


1 



and condition (7) is satisfied. Let M C SL(3, C) be the set of all Heisenberg transla- 
tions. 

Example 2. Dilations. Let 5 > 0. Then the dilation A^{z) = [5zi,5'^Z2) is a 
holomorphic automorphism of D^. Its matrix representation is 



A = 









1 

V (5 

It is easy to verify that A satisfies the condition (7). We denote the set of all dilations 
by ^CSL(3, C). 

Example 3. Rotations. Let </? e R. The rotation in the first variable by e**^, 
{zi, Z2) I— > {e^'^zi, Z2) is a holomorphic automorphism of D^. There are three matrices 



M 



/ p \ 


V (3 J 



P — e «¥'/3+27rife/3^ ^ _ 0, 1,2 corresponding to the same rotation. It is easy to see 
that M satisfies the condition (7). The set of rotations is denoted by Al = {M e 
SL (3,C); /3eC, = 1}. 

The next transformation is an involutive automorphism. 

Example 4. The involution J{zi,Z2) = is a holomorphic automorphism of 

mapping 00 into (0, 0). A matrix representation of J is 

/ 



J = 







-1 



V 







i \ 


0/ 



Notice that = /, and that every point of form (z, i) is a fixed point of J. 

Let 2; be a boundary point of D'^, i.e. z e dD^ U {00} The isotropy subgroup 
(stabilizer subgroup) of z contains all the holomorphic automorphisms that leave 
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z fixed, that is Y ^ = ^ Aut(CH^); g{z) = z}. Tlie isotropy subgroup of oo 
consists of lower triangular matrices, that is 

Too = {P e SL(3, C); P*CP = C,pn = P13 = P23 = 0}. 

The stabilizer group of 00, P = Too can be decomposed as the product 

V = AfAM. 

This decomposition is called Langlands decomposition. An element of the stability 
group P eV can be decomposed as 

PiiOO\ / I 00\ 



P21 P22 = NAM 

P31 P32 P33 / 

The Jacobi determinant of the automorphism 



^ (3-^ 



^ [ 921 + 5^22^1 + g23^2 ff31 +g32^1 +g33^2 \ 
Vfl'll + fl'12^1 + 5'13^2 ' 911 + 912Z1 + 913Z2 J 



e Aut(CH2) 



is given by the formula 

det G'{z) = (511 + ^12^1 + ^13-^2)"^- (8) 
We will use the notation Q{G) for the quadratic form 

Q{G) = \gu+9i2Zi+9i3Z2\^. (9) 

An analogue of the modular group SL(2, Z) in higher dimensional complex hyper- 
bolic space is the Picard modular group. 

Definition 1. The Picard modular group is a holomorphic automorphism group of 
CH" defined as 

r^{AeSL{n + l,C); A*CA = C, ajk e Z\i]}. (10) 



We recall that the condition ajk G Z[i] means that the entries of the matrix A are 
Gaussian integers, that is ^eajk, ^majk G Z. 

The Picard modular group, F, is a discontinuous subgroup of Aut(CH"). 

Remcirk 3. We note that the Heisenberg translation iV^^_,_i|^|2 is in the Picard mod- 
ular group, r, if and only if r e Z, and 7 is a Gaussian integer with the property 
that 

^ e Z. (11) 

We close this section by recalling the definition of fundamental domain [T]. Note 
that the fundamental domain is a closed set in this definition. 
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Definition 2. A set J-' C. is a fundamental domain for the automorphism group 
r cAut(CH") if 

(i) for all z e there is a G eT such that G{z) G J-'; 

(a) whenever z e J- andG{z) e T for some G e r\{/} then z lies on the boundary 
ofT. 

We introduce the definition of Siegel set in a metric space {X,d), [S]. Let F be a 
discrete subgroup of tlie isometry group of X. 

Definition 3. A closed subset S d X is a Siegel set for T if it satisfies the following 
two properties: 

(i) V • S — X, i.e. for all x & X there is a G & V such that G{x) e S; 
(a) the set {G eV; Sn G{S) ^ 0} is finite. 

Let L > and let A be the closed triangle in C with vertices 0, 1 and i. 

Definition 4. We define the closed subset S{L) as 

1 1 

S{L) = {ze C^; zi e A, \^ez2\ < -, ^mz2 - -|^i|^ > L}. (12) 

Zi Zi 

We proved in [FLl], [FL2] that if < L < then the set S{L) is a Siegel set 
for the Picard modular group F C Aut(CH^). 

2.1. Outline of the proof. . 

The basic idea of the proof can be described easily. In [FLl] we constructed a semi- 
explicit fundamental domain for the Picard modular group F. There are holomorphic 
automorphisms G\ = J, G2, • • • , Gn in the Picard modular group such that the set 

J" = {zeC^; < ^ftezi, < '=smzi, ^ezi + ^mzi < 1, 

\^ez2\<^, |^2r>l, \detG'j(z)\^<l, j^2,...,N} (13) 

is a fundamental domain for the Picard modular group acting on the complex hyper- 
bohc space CH^. The transformations Gj j — 2, . . . ,N satisfy the Siegel property, 
but are not known cxplicitlv- 

Let J^i = S{L) n{z e &; 1^2 1 > 1} = S{L) n {z e C^; | detG';(z)p < 1}. Clearly 
T 'd T\. We will prove that if G is one of the transformations Gj, j = 2, . . . , in 
the description of T in (13) then either 

(1) |detG"(z)| < 1 for all z e J^i, 
or 

(2) there is a transformation Gj, j = 2, . . . ,8 appearing in (2), (3) and (4) such 
that |detG'(2;)| < |detG^(2;)| for all z & Ti. In either case, the transformation G 
does not contribute to the fundamental domain T. 
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3. Proof of the Main Theorems 

. We recall from [FLl], [FL2] that any G = [gjk] G T \ Too can be decomposed as 
G — NJP. The matrix P — \pjk] G Too is lower triangular and parameterized by 
5>0, PeC with = 1, r e R, 7 e C as 



P31 = jir + P32 = ^7/3"^ P33 = PS. 



(14) 



The transformations and P in the decomposition of G = [gjk] € F \ Fqo are not 
necessarily in the Picard modular group F, the entries of N, P are not necessarily 
Gaussian integers. However 

9ij = iPsj, 3 = 1,2,3. (15) 

Lemma 1. Furthermore, the parameters 5, r, 7 in the decomposition of G = [gjk] G 
F \ Foo satisfy the following conditions: 

5>0, 1<5^ eZ, reZ, I7IV2 e Z, 5^^e^ e Z, S^^mj e Z. (16) 

Proof of Lemma 1. Since the entries gj^ are Gaussian integers the statement follows 



from the identities gngis 



r + i^, 1 < l^isl 



We proceed to reduce the number of the transformations used to describe the 
fundamental domain to a handful explicitly given automorphisms. 

3.1. Crude estimates for the automorphisms G2, ■ ■ ■ , Gn- 

Lemma 2. Let G — [gjk] £ F \ Foo be a holomorphic automorphism of CH^. // 
\9i3\ > -^/^zi ^^en Ig'ii + gi2Zi + gizZ2\^ > 1 for all z e Tx. 

Proof of Lemma 2. Since G ^ Foo we have gyi ^ and 

" - \9i3?\'^e 



\9ll +912Z1 +9l3Z2\ 



^^-^^^''+^e^z, + ^ez2\' + 



> 



\9l3 

\9l3 



9l3 

2\r^ 9n , 9l2 , , 



9l3 

9u 
I — 



9l3 

{<sm h <ym — zi + ksmz2) ■ 

913 913 



(17) 



Using that 



and (14), (15) we obtain 



912 
I — 

9l3 



Zl\ < 7.(1 



912,2 
'9l3 



9ii , 9i2 . . 
h <sm — Zi + ksmz2 > 



CN, 9ii 



+ \zi\') 

1 |5'12|2 



1 



9l3 



9l3 



+ ^mz2 \zi\ 



9i3 2 gi3 

;{^mp3ipls - -b32n + ^mZ2 



\9l3\ 



Qmz2 - - \zi\ 



(18) 
\z,\\l9) 
(20) 
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Since z e J^i we have \Slez2\ < 1/2 and \zi\ < 1 so \'^mz2\'^ > 1 — |3?e2;2p > |. This 
imphes that 

<s'rnz2 - -\zi\ > — - — Vz e J^i 

and proves Lemma 2. 

Corollary 1. Let G — [gjk\ G T \ he a holomorphic automorphism o/CH^. If 
there is a point z^ e T\ such that \ det G' {z'^)\^ > 1 then the possible values of \gis\ 
are 1, V2, 2 and VE. 

Proof of CoroUciry 1. Since 

|detG"(z)|2 = \gii + gi2Zi + gi3Z2\~^ 

Lemma 2 imphes that < [(^isp < jzfyg ~ 7.4641. The possible values of jg'isp for 
the Gaussian integer gi^ are the positive integers less than 8 that are sum of squares 
of integers. These are 1, 2, 4, 5. 

Lemma 3. Let G — [gjk] £ T \ Too be a holomorphic automorphism of CH^ with 
5 = Igisl — 1, -\/2, 2, -\/5. There is a number 7o((^) — 5 + ^(1 — -\/3)(5^ + 25 such that 
if \gi2\ > 1q{S) then \gu + g^zi + 5'i3^2p > 1 for all z e Ti. 

Proof of Lemma 3. We estimate the right hand side of (17) using that for all 
z — {zi, Z2) e J-i we have \zi\ > 1 and Qmz2 > So 

ga I gi2 , N \ I I gii i gi2 w i , \ 

ism \-^m — Zi + ^mz2) > \gi3\{^m | — \\zi\ + ksmz2) 

gi3 gi3 gi3 gi3 

'"'-IM^^S. (21) 



2(5 

The quadratic expression — I7I + ^5 is at least one if 



I7I > 7o(5) = 5 + ^J{l-V^)5^ + 25. 

Therefore \gii + g^zi + gi2.Z2\^ > 1 for all z e Ti'ii \gi2\ > 7o((^)- 

Remark 4. The approximate values of 7o(5) for 6 = l,\/2, 2,\/5 are as follows: 
7o(l) = 2.12603, 7o(a/2) = 2.58226, 70(2) = 3.03528, 7o(a/5) = 3.13711. 

Lemma 4. Let G = [gjk] G T \ Too be a holomorphic automorphism of CH^ with 
Igi^l = S e {1, a/2, 2, \/5}, \gi2\ < 7o(^)- There is a number ro{S) = S'yo{S) + y + 

S^l - 52(1 - ^) such that if \r\ = l^egngl^l > ro{S) then \gii + gi2Zi + gi3Z2\'^ > 1 
for all z ^ T\. 
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Proof of Lemma 4. Let z ^ J^y and \gY2\ < Then we have the estimate 



\r\ 

T 



< 



< 



^ - Qm^zi + 5Uez2 
p"^ 



+ \^\\zi\ + S\^ez2\ 



So 



and therefore 



7 - ^m^zi + S^ez2 
p"* 



> 



\9ll+9l2Zl +gi3Z2\ 



= {--^m^zi + SUez2f + 



7 



(-— + ^e—zi + 5Qmz2y 



25 



> 



.\/3- 1, 



according to the proof of Lemma 2. The right hand side is at least 1 for all z e ^ 
provided |r| > ro{5). 

Remcirk 5. The approximate values of ro{S) for S = 1,V^, 2,-\/5 are as follows: 
ro(l) = 3.55664, ro{V2) = 5.86186, ro(2) = 9.43305, ro{V5) = 10.7996. 

Lemma 5. Let G — [gjk] £ L \ Too be a holomorphic automorphism of CH^ with 
gi2 = ip32 = = 0, that is 7 = 0. Then \gii + gi2Zi + gi2,Z2\^ > 1 for all z e J^i. 

Proof of Lemma 5. If 7 = then 



\gii + gi2Zi + gi3Z2\ 



\y + (3Sz2\' 
^2 



> 



> 



52 



52 



-2\r\\?fiez2\ + S'\z2\ 



-\r\ + 5'. 



When r — then the statement follows from 5>1. IfreZ\{0} then |r| > 1 so 



r^-\r\+5^^{f-S)^+\r\ > 1. 

The next lemma rules out the case 5 — y/E. 

Lemma 6. Let G = [gjk] G T \ ^00 be a holomorphic automorphism of CH^ with 



1 513 1 



S — Then \gii + gi2Zi + gi3Z2\'^ > 1 for all z & Ti. 
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Proof of Lemma 6. According to Remark 4 and Lemma 5 the statement of Lemma 
6 is valid when = or |g'i2| > 7o('\/5) ~ 3.13711. So it is enough to consider the 
case when < |5'i2|^ < "YoiV^Y < 10. Since gugls — r + i^ is a Gaussian integer so 
Ifl'i2p = |7p £ 2Z. Then it is easy to see that the possible values of {gul'^ = |7p are 2, 
4, 8. Note that Ig^^gul^ = 6^'\j\^ = 5|7p, so IMgisQu)? + \'^rn{g^sgl2)? = 10,20,40 
with (|3?e(^i3(7i2)|, |Q'm(^i35'i2)|) G Z x Z. One can determine the possible values 
of the pair of integers {\^e{gi3gi2)\,\^m{gi3gi2)\) easily: (1,3), (3,1), (2,4), (4,2), 
(2, 6), and (6, 2). We consider these six cases separately in estimating equation (17). 
Using the notations Zi — Xi + iyi, = X2 + iy2 we have 

Qm— + Qm—zi + Qmz2 = + \^m{g u 9 13) xi + \^e{gu9i3)yi + 2/2 
9i3 9i3 10 5 5 

ItP 1 - 1 - 

> ^ - -^\^rn{gi2gi3)\xi - -\^e{gi2gi3)\yi + y2- 
CASE 1. If {\^e{gi3gu)\, \'^m{gi39i2)\) = (1,3) then I7P = 2 so 

- T\-^rn{gi2gi3)\xi - - \iiie{gi2gi3)\yi + y2 = - - -yi + y2. 



Since Zi G A, '^mz2 > ^ we have 

13 1 1112 2 ^ 

-xi- -yi+y2^ -xi - -yi ~ -xi + y2 >-- + —> 0. 
555 5555 52 

Therefore 

bii + 5'i2^i + 5'i3^2r > 5(— - ^)^ > 1 

for all z ^ T\. 

CASE 2. The case (|3?e(^i35fi2)|, |Q'^(^i35'i2)|) = (3, 1) is completely similar to the 
previous case. 

CASE 3. If (|Sfte(^i3^i2)|, |SJm(^i3^i2)|) = (2,4) then Yi\^ = 4 so 

U|2 \ ]_ 2 4 2 

- 1 3=771(512^13) I xi - -\^e{gx29\3)\y\^ y2 - -xx - -yi + y2- 



10 

Since zi E A, Qmz2 > ^ we have 

242 2222 2^3^ 

- - -xi - -2/1 + y2 = - - -xi - -yi - -xi + y2 >-- + —> 0. 
555 5555 52 

Therefore 

a/3 2 

Ifi-ii + 5-12^1 + 5'i3^2p > 5(— - -Y >l 

Z o 

for all z E J^i. 

CASE 4. The case (|3?e(^i35'i2)|, 10=777(^13(712) |) = (4,2) is completely similar to the 
previous case. 
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CASE 5. If {\M9i39i2)\, \^m{g,^g,2)\) = (2,6) then I7P = 8 so 



10 



-\Qm(gi2gi3)\xi - -\^e{gi2gi3)\yi + y2 = 7 - -ra^i - -yi + y2- 



Since ^1 e A, ^1^2 > ^ we have 

462 44422 2 ^/3 ^ 

- - -xi - -yi + y2 = - - -xi - -yi + -yi - -xi + y2 >-- + — > 0. 

555 55555 52 



Therefore 



Ifi-ll + 5-12^1 + fi'l32;2p > 5(— - -)^ > 1 

z o 



for aU z & J-'i. 

CASE 6. The case {\?R-e{gisgi2)\, \'^'rn{gisgi2)\) = (6,2) is completely similar to the 
previous case. 

This completes the proof of Lemma 6. 

3.2. Fine estimates for the automorphisms 6*2, . . . , Gat. The goal of this sub- 
section to obtain finer restrictions on Jacobian determinants of the possible auto- 
morphisms contributing to the unknown part of the fundamental domain. There are 
three different classes of possible automorphisms since the dilation parameter of these 
automorphisms can have only three values, 1, 2. In the next three subsections 
we analyze these three classes. The identity 



1/ , -17 



2 



Q{G) = \gu + guzi + gi3Z2\'^ = \^{r + i^) + i'yP ^zi + 6z2 

C^-Qm{^z,) + 5^ez2f + 



|2 

21 ' """'P^ 



^' +^e{^Zi) + SQmz2y 



2 



= iL-Qrn{px,-^e{py^ + 5x2j + 

+ - ^"^(py^ + ^y^) ' (22) 

for the Jacobi determinant of a transformation G — [gjk]: which is based on (14), (15) 
will be used several times. 

3.2.1. Class of automorphisms with dilation 5—1. In this section we determine all 
the transformations in the Picard modular group with dilation 6 = 1 which contribute 
to the boundary of the fundamental domain. It follows from Remark 4, Lemma 5 and 
(16) that < |7p < 5 and therefore the possible values of |7p are 2 and 4. Moreover 
6 = 1 implies that /3 = ±1, ±i. 

In the next lemma we eliminate the case |7p = 4. 
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Lemma 7. Let G = [gjk] G F \ T^o be a holomorphic automorphism of CH^ with 
bisl = \ip33\ ^5^1 and \gi2\^ = |7|2 = 4. Then \gii + g^zi + gi3Z2\^ > 1 for all 

z e JTi. 

Proof of Lemma 7. Since gis — i5p with \gi^\ — S — 1 then P — It follows 

from gi2 = — 7/9~^ that 7 is a Gaussian integer, thus 7 = ±2, ±2i. So the values of 
7/3-^ are ±2, ±2i. If 7/3"^ = 2 then 

Q(G') = (r - 2|/i + X2f + (2 + 2x1 + > (2 + 2x1 + 2/2)' > (2 + > 1 

for all z E J^i. Similarly, if 7/3"^ = —2i then 

g(G) = (r + 2x1 + 2:2)' + (2 + 2yi + 1/2)' > (2 + 2yi + ^2)' > (2 + > 1 

for all 2; G ^1. It is easy to see by interchanging xi and yi, r and — r, X2 and — X2 
that the remaining cases 7/?"^ = —2, 2i can be estimated similarly. We will consider 
the case 7/3~^ = —2 only. In this case we have to estimate 

Q{G) = (r + 2yi + X2)' + (2 - 2x1 + 2/2)'. 

If r > 1 then r + 2yi + X2 > l + 2yi + X2 > I + X2 > | so (r + 2yi + X2)^ > |. Moreover 
2 - 2xi + 1/2 > ?/2 > ^ so 2 - 2xi + 2/2 > I and therefore Q{G) > 1 for all z e Tx. If 
r < then we first estimate Q{G) in the region — | < X2 < 0. Since 2 — 2xi > and 

2/2 > — X2 for all 2; e ^1 we have 



giG) > (r + 2yi + X2)' + (2 - 2x1 + v^l - xi)2 
= (r + 2?/i)2 + 2(r + 2t/i)x2 + x^ + 



(2 - 2xi)2 + 2(2 - 2xi)a/1 - x^ + 1 



> l + 2(r + 2yi)x2 + 2(2-2xi)Vl-2;i 



> l + %iX2 + 4(l-xi)yr^ 



x| 



1 + 4yi(x2 + VI - a^i) + 4(1 - xi - 2/1) Jl - a;: 



because rx2 > in jFi. The last expression is nonnegative since 1 — Xi — t/i > 0, 
yi > and + ^\ - xl > -| + y^l - (1/2)2 = > in J^i. The same 

argument can be applied for r = 0, |x2| < 1/2. Now we consider Q[G) in the region 

< ^2 < |, r < -1. It is easy to estimate Q{G) if < Xi < Indeed, 
then 2 - 2xi + 2/2 > 2 - ^ + ^ = 1 so Q{G) > (2 - 2xi + ^2)^ > 1 in JTi. If 
^^X^ < Xl < 1 then using yi > 1 - xi we have r + 2yi + X2 < -1 + 2 - 2xi + | = 

1 - 2xi < < 0. So we get the lower bounds (r + 2yi + X2)^ > (§ - 2xi)2 and 



14 GABOR FRANCSICS AND PETER D. LAX 

Q{G) > (I - 2xif + (2 - 2xi + > (| - 2xiY + (2 - + The function on 

the right-hand side /(a;i) is strictly decreasing on the interval [ ^"^7^ , 1], because 



fix,) - 4 [ax, - < 

provided Xi < = 1.09151.... Therefore Q{G) > /(I) = 1 for all z e J^i, r < -1, 
< a;2 < |. This completes the proof of Lemma 7. 

Consider case |7p = 2. Our next step is to improve Lemma 4. 

Lemma 8. Let G = [gjk] G F \ Too be a holomorphic automorphism of CH^ with 
\gi3\ = 6 = 1, |5(i2p = |7p = 2. // |r| = l^egugia] > 1 t/ien \gii + 5(i22;i + 5132:2^ > 1 
for all z ^ T\. 

Proof of Lemma 8. In this case, it follows from (22) that we have to estimate 
Q{G) = i^-<^m{px,-^e{py, + x^ + 

[l + ^e{px,-^m{py, + y^ . (23) 

It follows from (16) that 7 is a Gaussian integer, so 7 = 1 + i, 1 — i, + —1 — i. 
Since /? = ±1, ±i we have j/3~^ = 1 + i, 1 — i, + —1 — i. Therefore 

2<\r\<\r- ^m{^)xi - Ke(-^)|/i + X2I + | - Qm{^)xi - M^)yi + ^^2! < 

77 773 
\r-^m{—)xi-^e{—)yi + X2\+xi+yi + \x2\ < \r-Qm{—)xi-^e{—)yi+X2\ + -, 

so 

- < |r - ^m{^)xi - Ke(^)|/i + X2\. 

Moreover 

7 7 

1 + Ke(— )a;i - ^m{—)yi + y2 > 1 - - y, + y2 > y2 > ^ 
in ^1. Therefore 

««).(i)%(f)^i 

for all 2; G JFi. This proves Lemma 8. 

Lemma 9. Let G = [gjk] G F \ Fqo be a holomorphic automorphism of CH^ with 
\gi3\ = S = 1, |5(i2p = |7p = 2. //7/?"^ = l + i,-l-i,l-i, and r = ^egug'is = 
—1, 0, 1 t/ien Ig^ii + gi2Zi + gi3Z2\^ > 1 for all z ^ T\. 
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Proof of Lemma 9. If 7/3^ = 1 z then 

Q{G) = {r + xi-yi + x2f + {l + xi+yi + y2f 

> (l + Xi+?/i+y2)'>(l + ?/2)'> + >1. 

The other two cases 7/3"'^ = and 1+i are similar, we will consider 7/3~^ = 

only. In this case 

Q{G) = {r + xi+yi + xa)^ + (1 - xi + yi + y2f. 

We may assume that < .Xi < 1 because 1— a;i+|/i+?/2 > ^—Xi+y2 > 1— > 1 
and Q{G) > (1 — a^i + ?/i + ?/2)^ > 1 otherwise. If r = — 1 then 

Q{G) = {-l+xi+yi + X2y + {l-xi + yi + y2f 
= {-l+xi+yif + 2{-l+xi+yi)x2 + xl + 
(1 - a;i + yi^ + 2(1 - x^ + yi)y2 + yl 

> 2{-l + xi + yi)x2 + 2{1 - xi + yi)y2 + I 

> 2(1 - a;i - yi) {-X2 + 1/2) + "^vm + 1 

> 2(l-xi-y0(-^ + ^) + l 

> 1 

because 1 — xi — yi > 0, X2 > — |, ^2 > | in ^i- If r = 0, 1 then r + Xi + yi + X2 > 
xi + X2 > xi - I > > so {r + xi + yi + X2Y > {xi - |)^. Moreover 

l-a;i+yi+y2 > 1-2^1+^2 > l-xi + ^ > # so (l-xi + yi + y2)' > (l + ^-xi)^. 
Therefore (5(G) > (xi — 1)^ + (1 + ^ — xi)^ = P(xi). The minimum of the polynomial 

P{xi) occurs at xi = > 1. Therefore Q{G) > P{xi) > P(l) = 1 for ^ e JT^. 

This completes the proof of Lemma 9. 

The remaining case is 7/3~^ = + In this case gu = il3{r + i), gi2 = + 
gi3 = i/3 with r = -1,0,1 and /3 = ±l,±i. So (5(G) = l^fn + guZi + 5'i3^2p = 
\r + i — {1 + i)zi + 2^21^, and therefore 

|detG'(z)|2 = |r + i- (l + ^)^l + ^2^^ r = -1,0,1. 

The stability component of G can be determined from the Langlands decomposi- 
tion: 

/ /3 

V /3(r + z) -(1 + z)/? /? 
with r = —1, 0, 1. Select (3 — —1. Consider the transformations G3+J. = JP^+r- Then 
the Jacobian determinant of Ga+r is 

I det G'3+,(^)|' = |r + i - (1 + i)z^ + ^2^^ r = -1, 0, 1. 
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The transformation G^+r satisfies the Siegel property, namely there are points Rs+r G 
S{L) such that Gs^r{R3+r) £ S{L) for r = —1, 0, 1. Indeed, it is easy to see that one 
can select R2 = (| + 2 3^, + i(l + e)), R^ ^ + i) , i{l + e)) , i?4 = (^+i|,A + 
i(l + e)) for sufficiently small e > 0. 

3.2.2. Class of automorphisms with dilation S = -\/2. Let G = [gjk] G F \ Too be a 
holomorphic automorphism of CH^ with dilation parameter 6 = \gis\ = \f2. Then it 
follows from (14) and (15) that |p33p = (3^6^33)^ + (Smpsa)^ = 5^ = 2, so 9fJep33 = ±1, 
Smp33 = ±1, that is the values of P33 are P33 = — 1 — i, — 1 + i, 1 — i, 1 + i. This 
determines the values of /3: 

-1+i 1-| 1+1 
^ ^ ' V2 ' V2 ' ^ ■ ^ ^ 

Note that the corresponding values of are i, — i, — Using (14) again we get 
from 7 = — i/9^p32 that 7 is a Gaussian integer. Since I7P = 29'm(p3ip33) G 2Z and 
< I7P < 7o(\/2)^ < 2.6^ < 7 according to Remark 4 and Lemma 5, the possible 
values of I7P are 2 and 4. Indeed 6 is not a possible value since it can not be written 
as sum of squares of two integers. 

Our next step is to eliminate the value 4 for |7p. 

Lemma 10. Let G = [gjk] G L \ Too be a holomorphic automorphism of CH^ with 
\9i3\ = NpssI ^ S ^ and \gi2\'^ = |7|2 = 4. Then \gu + gi2Zi + 5'i3^2p > 1 for all 
z e Tx- 

Proof of Lemma 10. We recall that 

/HI 1 1 
Q{G) > + ■^'^m{p32P33)xi + ^3?e(p32P33)Z/l + y2 

1 1 
= 2(1 + -'^m{p32P33)xi + -5Re(]?32P33)yi + y2f- (25) 

Since 1^6(^32^33) P+ 1 ^^"^(^32^33)^ = 1^32^33^ = ^^|7p = 8 we know that |3?e(p32P33)| = 
2 and \'^m{p32P33)\ = 2. This gives the lower bound 

1 1 

1 - -|9m(p32P33)kl - 2l^^(^^32P33)|yi + ^2 = 1 " 2^1 " ^1 + ^2 > ^2 > ^ 

for the quantity in the parentheses on the right hand side of (25). Therefore 

a/3 

1^11 + gi2Zi + gi3Z2\^ > S^l -xi-yi + ^2)' > 2(^)' > 1 

for all z E J^i. This completes the proof of Lemma 10. 

Now we turn our attention to the case S = ^/2, I7P = 2. In this case |3?e(p32P33)|^ + 
\'^m{p32P33)\'^ = |p32P33p = 5^|7p = 4. Then we know that the pair of integers 
(|3?e(p32P33)|, \^'m'{p32P33)\) IS cqual to (0,2) or (2,0) so P32P33 = -2i,2i, -2,2. The 
next lemma further reduces the possible values of ^32^33- 
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Lemma 11. Let G = [gjk] G F \ T^o be a holomorphic automorphism of Ctf with 
\gi3\ = \ip33\ = S ^ V2, |5'i2p = |7p = 2 and g^gia = 2i,2. Then \gii + g^zi + 
5'i3-Z2p > 1 for all z e Ti. 

Proof of Lemma 11. Similarly to (25) we have 

11 1 
\gii + gi2Zi + gizZ2\^ > 2(- + -^5771(^32^33)3^1 + 2^^b32P33)yi + y2f 

in this case. If gufjis = P32P33 = 27 then we get the lower bound 

2(^ + ^i + y2)^>2(^ + ^)^>l. 
The other case, gugia — P32P33 = 2, gives the lower bound 

2{l+y^+y,r>2il+y^r>i. 

These lower bounds imply Lemma 11. 

In the next lemma we analyze the remaining two values of g'12^13 = P32P33, —2, 

-27. 

Lemma 12. Let G = [gjk] G F \ Fqo be a holomorphic automorphism of CH^ with 

\9n\ = Imsl = 5 = y/2, |5'i2p = |7p = 2, 912913 = -27, -2. 
(i) Then r = ^e{giigi3) E Z is an odd integer. 

(a) If \r\ = \?R.e{gugi3)\ > 3 then \gu + g^zi + gi3Z2\'^ > 1 for all z e Tx. 
(Hi) The possible values of r — '^e{gi\giz) £ Z are ±1. 

Proof of Lemma 12. To prove (i) wc start with the formula p^i = f (?" + ^■'^) = 
;^(r+7). Using the values of /3 from (24) we obtain that -^ij+i) = — |(r— l+7(r+l)), 
i(-r - 1 + 7(r - 1)), i(r + 1 + i{-r + 1)), or |(r - 1 + i(r + 1)). So the values of 
3?ep3i e Z are — or ^ and therefore r is an odd integer. 

We recall that 

/ r 1 1 ^ ^ 

Q(G) > ^ + ^5^e(p32P33)a;i - -^'^m{p32p33)yi + 2:2 

'^1 1 \' 

+ -^^m{P32P33)xi + ^3?e(p32P33)2/l + 2/2 • (26) 

We will only consider the case (712^13 = —2i because the other case can be handled 
similarly. Since P32P33 = -2? the right-hand side of (26) is equal to 

2(^ + 7/l + X2)' + 2(^-Xi + 7/2)'. (27) 
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We may assume that i+v^ ^ < a;i < 1. Indeed, otherwise we have < < i+v^ 



and 



1 1 1 + V3 1 

2-^^ + ^^-2 2 + ^ = 



According to (27) we get the lower bound 1 for all z ^ T\. 
We know that < yi < 1 - Xi < Therefore 



Irl ,r , , , T , + 1 



So if Irl > 3 then 



+ 1/1 + a;2| > 



|r| x/3-v/2 ^3 V3-v^ ^ l + v^-v/2 

2 2-2 2 2 



Using the trivial lower bound | — Xi+1/2 > 5 — 1 + "^ convexity of we get 



^ ^2 , ™ , „. N2 



Q{G) = 2(- + yi + a;2)' + 2(--xi + y2) 



> 2(^ + ^-^)- + 2 



2 , o^^- 1)2 



2 ' ' 2 
(1 + ^3- V2)^ + (V3-1)2 



> ( 



2V3- ^2 



)2>1 



for all z ^ T\. This completes the proof of (ii). According to Lemma 11 and 12 the 
possible values of r are odd integers between —2 and 2. This completes the proof of 
Lemma 12. 

The remaining two cases are gvi9vi = — 2i, —2, with r — —1, 1, I7P = 2, and /3 as 
in (24). 

Consider first the case g^Slis = — 2i. In this case (713 = ip^^ = iV2P, gn = ip^i = 
i^{r+i), gi2 = ip32 = V^P- So Q{G) = |i^(r+i) + V^/3^i+iV2/9^2p, and therefore 



det G'(z) 



.r + i 



iV2zi + V2z2\~^, r = -l,l. 



The stability component of G can be computed easily by using the Langlands 
decomposition: 



r ^ \ 

1^ ^(r + i) V2(3 ) 
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with r = —1, 1. Select /3 = Consider the transformation G5_,_i+r = N^^^r+i~^ o 

J o P^_^_l±r. This transformation is in the Picard modular group since its entries are 
Gaussian integers. The Jacobian determinant of G^_^_l+r is 



detG'^^i^{z)\^ = \'^-iV2zi + V2z2\-^ r = -1,1. 



The transformation G^_^_i±r satisfies the Siegel property, that is, there a point R^^i±r e 
S{L) such that , i+r (R^ , i+r ) e S{L). Indeed, since G^ , i+r (zi . i^^i ) = {zi,izi) one 
can select .Rg , i+r- = (1 — 2e + ie, — e + i(l — 2e)), r = —1, 1, for some small e > 0. 

Now consider the second case g^Slis = —2. In this case gi^ = ip^^ = iV2P, gu = 
ip3i = i^{r + i), gi2 = ip32 = -iV2p. So Q{G) = \i^{r + i) - iV2pZi + iV2/3^2p, 
and therefore 

|detG"(^)|2= |^-^/2^l + ^/2^2|-^ r = -l,l. 
v2 

The stability component of G can be computed easily by using the Langlands 
decomposition: 



Pr 



7+^ 



l+r 



/ ^ \ 



with r = —1,1. Select {3 = Consider the transformation Gy , i+r = iV^^ r+i^ o 

J o P~,i±r. This transformation is in the Picard modular group since its entries are 

'+ 2 

Gaussian integers. The Jacobian determinant of Gj_^_i±r is 



detG'i+r{z)\^ = 1^ - V2zi + V2z2\-^ r = -1, 1. 



The transformation G-jj^i±r_ satisfies the Siegel property, that is, there is a point 
Rj I i+r e S{L) such that Gy+i+r (-Ry+i+i) e S{L) because G'j_^i+r{z\,z\) — {z\,zi). 

3.2.3. Class of automorphisms with dilation 5 = 2. Let G = [gjk] G P \ P^o be a 
holomorphic automorphism of CH^ with dilation parameter 5 = \gi3\ = 2. Then it 
follows from (14) and (15) that Ipsal^ = 5^ = 4. This determines the possible values 
of the Gaussian integer P33 = 5(3 and /3: 

P33 = -2, 2, -2i, 2i, (5 = -1, 1, -i, i. (28) 

Since (3"^ = 1,-1 using (14) again we get from 7 = —if3'^p32 that 7 is a Gaussian 
integer. Since I7P = 2$5m(p3ip33) G 2Z and < I7P < 7o(2)^ < 3.1^ < 10 according 
to Remark 4 and Lemma 5, the possible values of I7P are 2, 4 and 8. Indeed 6 is not 
a possible value since it can not be written as sum of squares of two integers. 

Our next step is to ehminate the values 2 and 8 for |7|^. 
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Lemma 13. Let G = [gjk] G T \ Too be a holomorphic automorphism of CH^ with 
\gii\ = =5 = 2 and |g'i2p = \^\^ = 2, 8. Then \gix + gi2Zi + gizZ2\^ > 1 for all 
z e Ti. 

Proof of Lemma 13. Consider the case |7p = 2. We recall that 

/HI 1 1 

Q{G) > I + ^Q^?7l(p32P33)2;i + ^3'^e(p32P33)yi + 2/2 

11 1 
= 4(- + |SJm(p32P33)2;i + |3?e(p32P33)?/l + ?/2)^- (29) 

Here 3?e(p32P33), 3^m(p32P33) are integers and 

|3'^e(p32P33)r + l^"^(P32P33)P = 1^32^33^ = ^"^ll? = 8- 

So the possible value of the pair (|?Je(p32P33) |, |Q'^(P32P33)|) is (2,2). This gives the 
lower bound \ - \\'^m{p^2Pii)\xi - \\^e{p^2Pzi)\y\ + ^2 = i - l^i - l^i + ^2 = 
\ — \xi — \yi + 1/2 — |>y2 — |>-^ — |>|for the quantity in the parentheses on 
the right hand side of (29). Therefore 

Q{G) = \gn + g^2Zi + ^13-22!' > S^^f = 1 

for all z G J-'i. 

A similar argument works for the case I7P = 8. Indeed, in this case 

|3^e(p32P33)P + |^^"-i(P32P33)P = |j>?2p33p = ^^ItP = 32, 

the possible value of the pair (| 3^6(^32^33)!, \^rn{p^2p33)\) is (4,4). Therefore 

Q{G) > ^l + ^^m{p32P33)Xl + ^Ue{p32P33)yi+y2f 

> 4(1 -x,-y,+ y2f > Ayl > 4(^)2 > 1 

for all z E J-'i. 

This completes the proof of Lemma 13. 

Now we turn our attention to the case 5 = 2, I7P = 4. In this case \^e{p32P33)\^ + 
|^^(P32P33)P = b32P33p = ^^ItI^ = 16. Then we know that the pair of integers 
(|Ke(p32P33)|, \Qm{p32p33)\) is equal to (0,4) or (4,0) so P32P33 = -4i,4i, -4,4. The 
next lemma further reduces the possible values of P32P33. 

Lemma 14. Let G = [gjk] G T \ Too be a holomorphic automorphism, of CH^ with 
\9i3\ = \iP33\ =5 = 2, |5(i2p = I7P = 4 andgi2gi3 = 4:iA- Then \gii+gi2Zi+gi3Z2\^ > 
1 for all z E T\. 

Proof of Lemma 14. Similarly to (25) we have 

11 1 

IS'll + 9V2Z\ + g\3Z2f > 4(- + -^>m(p32P33)2^1 + ■^^e{p32P33)yi + Z/2)^ 
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in this case. If guQis = P32P33 = 4i then we get the lower bound 
The other case, (712^13 = P32P33 = 4, gives the lower bound 

4(^ + yi + y2r>4(^r = i. 

These lower bounds imply Lemma 14. 

Lemma 15. Let G = [gjk] G F \ be a holomorphic automorphism of CH^ with 
\gn\ = Imsl ^ S = 2, \gi2\^ = |7|^ = 4 and guQn = -4i, -4. 

(i) If \r\ = |3f?e^ii^i3| > 4 or r = then Q(G) > 1 for all z e J^i. 

(a) The number r = ^egucji^ & Z is even. 
(Hi) The possible values of r E Z are ±2. 

Proof of Lemma 15. To prove (i) we use (17) and (22). It is easy to see that 

n(r\ _ / (i + 2yi + 22:2)' + (1 - 2x1 + 2^2)' if ^12^13 = -4i, 

- I _ + 2x2)' + (1 - 2yi + 2y2)' if ^12^13 = -4. ^'^^> 

We will concentrate on the first case only, the other case is similar. We may assume 
that VS/2 <xi<l. Indeed if < Xi < \/3/2 then 1 - 2xi + 2|/2 > 1 - 2xi + a/3 > 1 
so Q{G) > 1. Wc know that 0<yi<l — Xi<l — a/3/2 in JF^. This means 
\r\/2< 11 + 22/1 + 2X2I + 22/1 + 2|x2| < If + 2^/1 + 2x21 + 2-73 + 1. If |r| > 4 then 
we have 

0<2 + a/3-3<|^| + a/3-3< |^ + 2yi + 2x2|. 

Therefore Q{G) > (\/3 - \f + (-1 + ^3)^ > 1 in Tx- 
If r = then 

g(G) = 4[(yi + X2)' + (i-xi + 2/2)1. 

We again may assume that a/3/2 < xi < 1. Since |x2| < |, < Xi < 1, we have 

^1 - xi > ^/2 and |-xi+y2 > |-Xi + ^l-xl > |-Xi + v^/2 > (v^-l)/2 > 
in T\. Therefore 

Q{G) > 4[(|/i+X2)^ + (^-xi + 0^)1 

= 4[yl + 2yiX2 + x^ + ^ - Xl + x^ + 2(^ - Xi)^l-xi + 1 - x^] 

,1 



> 4[- - Xl - 2IX2I2/1 + 1 + X? + 2(- - xi)^l - xi]. 
Since 1/2 < ^3/2 < xi so (i - Xi)^l - xi > | - Xi. Therefore 
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Q{G) > 4[--x^-y, + l + xl + 2{--x^)] 
> + (xi - 1)2] > 1 



in jFi. 



(ii) It follows from (14), (15) and (28) that gn = /3(|i - 1) with /? = ±1, ±i. Since 
gii is a Gaussian integer, we get that | G Z, that is r is even. 

(iii) Since < |r| < 4, r G Z is even, the only possible value of r is ±2. This 
completes the proof of Lemma 15. 

Now we summarize the case 6 = 2. Let g & T \ be an automorphism with 
^ = IqisI — 2. Then it follows from Lemma 13, 14 and 15 that either | det G'{z)\ < 1 
for all z e J^i, or gu = i/3(| + i), gi2 = 2/3, — 2i/3, gis = 2ip with /3 = ±l,±i 
and r = ±2. In the former case the transformation G does not contribute to the 
fundamental domain J^. In the latter case 

n(r\ - / + ^) + + = Ii + ^ - 2i;2i + 2z2\^ if 512 = 2/3, 

\ K/3(i + i) - 2i/3zi + 2iPz2\^ = \^ + i-2zi + 2z2p if gi2 = -2i/3 

with r = ±2. We recall that Q{G^_^_i±k) = + i — 2izi + 2z2\'^, Q{Gj_^_i+k) = 

j\k + i — 2z\ + 2z2^ with k = ±1. So (^(G) is a multiple of one of QiGj) for 
i = 5, 6, 7, 8. Indeed 



If for some point z G J^i, Q(G)(2;) < 1, then Q{Gj) < \ for a j G {5, 6, 7, 8}. Therefore 
no transformation with dilation parameter 5 = 2 contributes to the fundamental 
domain T. 

Proof of Theorem 1. The proof follows the outline described in section 2.1. Let G 
be one of the transformations G2, ■ ■ ■ ,Gn appearing in the description of ^ in (13). 

According to Lemma 2 and 6 the dilation parameter of G is 1, v^, or 2. In section 
3.2.1 we proved that if the dilation parameter of G is 1 then cither G G {G2, G3, G,i} 
or I det G'{z)\ < 1 for all z E J^i D J^. In the latter case the presence of the condition 
I det G"(2;) I < 1 in (13) is not relevant. Similarly if the dilation parameter of G is 
y/2, we proved in section 3.2.2 that either G G {G5, Ge, G7, Gg} oi |dctG'(2;)| < 1 
for all z E T\ ^ T . In the latter case the transformation G does not contribute 
to the description of T in (13). If the dilation parameter of G is 5 = 2, we proved 
in section 3.2.3 that either |detG'(2;)| < 1 for all 2; G ^1 D again, or there is 
a transformation G G {G5, Ge, G7, Gg} such that |detG'(2;)| < |detG'(2;)| for all 




2g(G5) if 512 = 2/3, r = -2 

2Q{G^) if 512 = 2/3, T = 2 

2Q{Gj) if 512 = -2^/3, r = - 

2Q{Gs) if5i2 = -2z/3, r = 2. 



2 



PICARD MODULAR GROUP 



23 



z 1^ T . Therefore the restriction | detG'(2;)| < 1 in (13) does not have an effect 
on the fundamental domain for any transformation G e {(j2, ■ ■ ■ , Gjv} with dilation 
parameter 8 — 1. This completes the proof of Theorem 1. 

Proof of Theorem 2. Theorem 2 follows from Theorem 1. Since the transformations 
G2, • • • , are explicitly given, one can easily compute the Jacobian determinants 
det G){z), J = 2, . . . , 8 according to (8). The inequalities | det G){z)\ < \ 3 = 2, . . . 
in the statement of Theorem 2 are identical to the last three inequalities appearing 
in the definition of T in Theorem 1. 

All eight transformations Gi, . . . , Gg are needed in the description of the funda- 
mental domain in T in Theorems 1, 2. In other words, if one of Gi, . . . , Gg is omitted 
in the description of ^, the set obtained is strictly larger than T. This can be easily 
verified by examining the location of the points 

Pi(0.2 + 0.2i, 0.1 + 0.8i), P2(0.25 + 0.72i, 0.45 + 0.9i), 
P3(0.39 + 0.6i, -0.45 + 0.9i), P4(0.72 + 0.25i, -0.45 + 0.9i), 
P5(0.7 + 0.05i, 0.45 + 0.9i), P6(0.7 + 0.02i, -0.45 + 0.9i), 
P7(0.02 + 0.7i, 0.45 + 0.9i), P8(0.02 + 0.7i, -0.45 + 0.9i). 
Simple calculation shows, that, if 1 < A; < 4 then 

' > 1 if 1 < J < 4, j ^ ^, 
Q,(Pfe) = <| <1 ifj = A;, 

> 2 if 5 < j < 8; 



and if 5 < A; < 8 then 



Qj{Pk 




if 1 < J < 4, 
if i = k, 

if 5 < i < 8, i ^ k. 

Moreover the points P,-, j — 1,...,8, satisfy the conditions < ^ezi, < '^mzi, 
^ezi + Qmzi < 1, |3fJe2;2| < |- The proof of Theorem 2 has been finished. 
Proof of Theorem 3. (i) The transformation S preserves the four inequalities, 
< ?R.ezi, < '^mzi, ^ezi + '^mzi < 1, and \?R.ez2\ < | in the definition of 
automatically. An easy calculation shows that 



QiiS{z)] 


= Qi{z 


Q2{s{z): 


= Qiiz 


QsiSiz)] 


= Qz{z 


Q4{s{z): 


= Q2{Z 


Q^iSiz)] 


= Qsiz 


QeiSiz)] 


= Qi{z 


Q7{S{Z)] 


= Q%{z 


Qs{S{z)] 


= Q^{z 
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Therefore the transformation S maps T onto itself since S'^ ~ I. 

(ii) It is enough to show that the inequahties |3?e2;2| < |, '^mz2 > 0, 1^21 > 1 imply 
that (0, Z2) e J^i, that is, 

\r + i + Z2\'^ > 1, for r = -1,0,1 

and 

\r + i + 2z2\^>2, for r = -1,1. 

This follows from ^mz2 > \/3/2, \r + i + Z2\'^ > (1 + Qmz2y > 1 and \r + i + 2z2\'^ > 
{l + 2'^mz2y > {l + Vsf > 2. 

(iii) We will prove the statement for any a > 1 + 2\/2. If 'ismz2 > a, \zi\ < 1, 
\r\ < 1 then 

1 + 2\/2 < a < \z2\ < \r + i-{l + i)zi + Z2\ + \r + i-{l + i)zi\ 

< |r + i — (1 + i)zi + 2:2! + |r + i| + |1 + i| 

< \r + i-{l + i)zi + Z2\+2V2. 

So \r+i-{l+i)zi+Z2\ > 1. Similarly \r+i-2izi+2z2\ > \/2and \r+i-2zi+2z2\ > \f2. 
Therefore {z e C^; < ^ezx, < "^mzx, 3?e;2i + $jm^i < 1, \^ez2\ < 1/2, '^mz2 > 
a} C T. This completes the proof of Theorem 3. 
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